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Abstract 

We study a class of rotation invariant determinantal ensembles in the complex 
plane; examples include the eigenvalues of Gaussian random matrices and the roots of 
certain families of random polynomials. The main result is a criteria for a central limit 
theorem to hold for angular statistics of the points. The proof exploits an exact formula 
relating the generating function of such statistics to the determinant of a perturbed 
Toeplitz matrix. 

1 Introduction 

Consider the probability measure on n complex points, Zi, . . . , z n 6 C, denned by 

1 - 

Pm,n(zi,...2») = \\ \Zj - Z k \ 2 JJdm(,2fc), (1] 



m ' n j<k k=l 



with a (positive) reference measure m on C. This is an instance of a determinantal ensemble, 
so named as the presence of the Vandermonde interaction term F] \zi — Zj\ 2 results in all fc-fold 
(k < n) correlations of the points being given by a determinant of a certain k x k Gramian. 
Determinantal ensembles as such were identified in the mathematical physics literature as a 
model of fermions |15] , but also arise naturally in a number of contexts including random 
matrix theory. For background, [11] and (20] are recommended. 
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Throughout the paper we restrict to the situation of radially symmetric weights, dm(z) = 
dfi(r)d8 (z = re l9 ), also assuming that m has no unit mass at the origin. The standard 
examples in this set-up are the following: 

Ginibre ensemble. Let M be an n x n random matrix in which each entry is an independent 
complex Gaussian of mean zero and mean-square one. Then the n eigenvalues have joint 
density (JT]) with dfi(r) = re~ r dr [8]. 

Circular Unitary Ensemble ( CUE). Place Haar measure on n-dimensional unitary group U (n) 
and consider again the eigenvalues. These points live on the unit circle T = {£eC:|£| = l}, 
and it is well known that their joint law is given by (pQ) in which /x is the point mass at one. 

Truncated Bergman process. Start with the random polynomial z n + 5^fc=o a k zk with inde- 
pendent coefficients drawn uniformly from the disk of radius r in C. Condition the roots 
Zi, . . . , z n to lie in the unit disk. Then, the r — > 00 limit of the conditional root ensemble is 
(JTJ) where now /z is the uniform measure on the disk of radius one. This nice fact may be 
found in JTU]; for an explanation of the name see |16j . 

Our aim is to identify criteria on /1 under which a central limit theorem (CLT) for the 
quantity 

n 
k=l 

holds or not. Whatever criteria will depend on the regularity of the test function / as well. 
An enormous industry has grown up around CLT's for linear statistics in determinantal and 
random matrix ensembles. Despite rather than because of this, there are several reasons for 
making a special study of such "angular" statistics in the given setting. 

The conventional wisdom is that choosing / sufficiently smooth produces Gaussian fluctu- 
ations with order one variance (i.e., as n — > 00 the un-normalized Xj n — EXj n should posses 
a CLT). This is borne out by a number of results pertaining to ensembles with symmetry 
and so real, or suitably "one-dimensional", spectra. In the present context in which points 
inhabit the complex plane, [18] proves a result of this type for C l statistics of the Ginibre 
ensemble. On the other hand, a smooth function of argz is not smooth when regarded as a 
function of the variable zeC In fact, again for the Ginibre ensemble and for / possessing 
an L 2 -derivative, [T7] shows the variance of Xf >n to be of order log n but is unable to establish 
a CLT. While there are a number of general results on CLT's for determinantal processes in 
whatever dimension, notably [21] which employs cumulants, the logarithmic growth in this 
case is not sufficiently fast for those conclusions to be relevant. We also mention that for 
any determinantal process on C with radially symmetric weight, the collections of moduli 
\zx\, \zz\, . . . are independent; this is spelled out nicely in [UJ. Hence, CLT's for "radial" 
statistics in our ensembles may be proved via the classical Lindenberg-Feller criteria, see [7] 
and [TTj for details in the Ginibre case. 
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It is likely that the considerations of [IB] , which entail a refinement of the cumulant 
method, can be adopted to the matter at hand. Here though we take an operator-theoretic 
approach, based on the following formula. For any ip G L°°(T), 



E 



k=l 



detM Mjn (v9), M„ n (ip) = {tpk-lQki)a<k,l<n-ii ( 2 ) 



where (fk = j- (p(x)e tkx dx, the k-th Fourier coefficient of <p, and 



oc 



Qk,i = i — mfc+ \ 1/9 in which m k = / r k dp(r), (3) 

the k-th moment of the half-line measure p,. The brief derivation of ([2]) can be found in the 
appendix. 

This provides an explicit formula for the generating function of Xf, n by the choice <p = 
e lX f . A CLT for Xf >n will then follow from sufficiently sharp n — > oo asymptotics of the 
determinant on the right hand side of (T5]). Of course, if this is to be the strategy we must 
henceforth assume that rrik < oo for all k. 

In the case of CUE, all = 1, and the identity (T5]) reduces to Weyl's formula relating 
the Haar average of a class function in U(n) to a standard Toeplitz determinant. The strong 
Szego limit theorem and its generalizations to symbols of weaker regularity then imply a 
variety of CLT's for linear spectral statistics in U(n), see for instance [12] and references 
therein. For more generic /i, what appears on the right hand side of ([2]) is the Hadamard 
product of (truncated) Toeplitz and Hankel operators. While Hankel determinants arise as 
naturally as their Toeplitz counterparts in random matrix theory and several applications 
have prompted investigations of Toeplitz + Hankel forms (see for example [2j), the present 
problem is the first to our knowledge to motivate an asymptotic study of Toeplitz o Han- 
kel matrices. Though, as the title suggests, the analysis more closely follows the Toeplitz 
framework. 

To describe the regularity assumed on the various test functions /, we introduce the 
function space Ft v {y\ 1 < p < oo (see [13]), comprised of all / G L : (T) such that 




ll/II^M : = >. < °°- ( 4 ) 



Here v = {z/ n }^ = _ 00 is a positive weight. (As above, /„ stands for the Fourier coefficients of 
/.) We will in particular deal with the cases p = 1 or p = 2, and power weights v n = (l + \n\) a , 
a > 0. In the latter case we simply denote the space by Fl v a and write Fl v when o = 0. 

As for the underlying probability measure //, a natural criteria arises on the second 
derivative of the logarithmic moment function. 
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Moment assumption. The function 

POO 

£^m e := / r^dfi(r), £ > 0, (5) 
Jo 

satisfies one of the following two sets of conditions. 
(CI) or "ff > 1" : It holds 

0n mi )" = O(r P ), e^oo, (6) 

with f3 > 1. 

(C2) or "1/2 < ft < 1" : It holds 

(lnm f y = M0 + O(r e ), ( ? ) 
for a differentiable function > 0, £ > 0, such that 

M0 = o(r /S ), ^(0 = o(r 7 ), e^oo, (8) 

with 1/2 < /3 < 1, g,7 > 1. Additionally, 

v(^) ^= J / MO^, (9) 



tends to infinity as rr — > oo. □ 

Notice that since we have already assumed < oo for all k, is infinitely differentiable 
for positive £. The typical behavior we have in mind in both (CI) and (C2) are asymptotics 
like 

{\nm (i )" = aC P + 0{C e ), e^oo, (10) 
with a, (3 > and g > 1 . As examples, we remark that for Ginibre, (lnra^)" = |£ _1 +0(£ -2 ), 
while both CUE and truncated Bergman satisfy (lnm^)" = 0(£~ 2 ). The transition from 
/3 < 1 to j3 > 1 is particularly interesting; Section 2 discusses the moment conditions in 
greater detail. The restriction to ft > 1/2 is tied to the method in which we show that M^ n 
is a small perturbation of the associated Toeplitz form, in either trace or Hilbert-Schmidt 
norm, and this breaks down at /3 — 1/2. By considering the perturbation in higher Schatten 
norms it may be possible to push our strategy further. 

Theorem 1.1 Assume the moment condition (C2) 7 and let a = max{l//3, 3/(27)}. Then, 
for real-valued f G F£„, the normalized statistics 

converges in law to a mean zero Gaussian with variance k 2 \f k \ 2 as n ^ 00. 
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If we assume the particular asymptotics (flOl) . then we obtain 



t M (2n) 



a log(2n) 
2 



= 1, 



W V2</3<1, 



which up to the constant stated in the theorem is the asymptotics of the variance of Xf iTl . 
For canonical ft = 1 cases like Ginibre, we have a = 1 and hence the assumed regularity on 
/ is optimal. For ft < 1, because the asymptotic variance of X n j is ~ n 1 ^ 13 and the mean 
is ~ n, one may conclude a CLT from [21] (even for ft < 1/2), though for possibly different 
classes of /. This highlights what our method can and cannot accomplish. 

Next we define the infinite version of the matrix M Mj „ and the related Toeplitz operator 

T, 

M^a) = (Qj^a-j-k) , T(a) = , j,k> 0, (11) 

both viewed as bounded linear operators on £ 2 = £ 2 (Z + ), Z + = {0, 1,2,...}. 

Theorem 1.2 Assume the moment condition (CI), and assume f to be real-valued. 

(a) Iffe F£ 2 1//3 for ft < 2 or f £ Fl\ /2 n L°°(T) for ft > 2, then 

Xf t n -nfo=> Z 
as n — )■ oo with a mean-zero random variable Z = Z(f; //). 

(b) If f G -FfJ. or f £ Fil^, where a = max{l,2//3}, e > 0, i/ien i/ie cumulants c m of Z 
may be described as follows. Introduce the recursion 

m-l / _ i \ 

C m = M fl (f m )-J2 [ k )Cm- k M,(f k ), m>l. 
k=i ^ ' 

Then c 2 (Z) = Var(Z) = trace C 2 + YlT=i k\fk\ 2 > while c m (Z) = trace C m for m > 3. 

For CUE, = 1 and one can check that ci(Z) = 2 Y^k=i ^|/fc| 2 , c m = for all m > 3 
and so Z is Gaussian. That is to say the obvious: Theorem 11.21 reduces to the strong Szego 
theorem. In general though it does not appear efficient to compute the cumulants of Z from 
the formula above, even in explicit, and seemingly simple examples like truncated Bergman 

for which = 2 ^^^2 ~~ ~' ^ ne more basic problem which remains open is to determine 
when Z is Gaussian, i.e., for what weights /i does c m vanish for all m > 3. We conjecture 
this is only the case for CUE, when [i is a unit mass. The intuition is that whenever say 
fi is compactly supported, the normalized counting measure of points concentrates on the 
boundary of a disk (as in CUE, this is discussed further in Section 2). If however \x has extent 
(is not concentrated at one place), there remains a positive number of points of modulus < 1 
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with probability one as n — > oo; their non- normal law will not wash in the type of centered 
(but not scaled) limit considered in Theorem 11.21 

Theorems 11.11 and 11.21 are intimately connected to the following, direct generalization of 
the Szego-Widom Limit Theorem to the determinants of M ftn (a). 

Theorem 1.3 

(a) Assume the moment condition (C2) ; let o = max{l//3, 3/(27)} and B = Fi 2 [y) such 
that v m = V- m , v m is increasing (m > 1), and 



v m > maxi (1 + \m\Y, Jl + m%(2|m| 2CT ) \ , sup — < 00. (12) 

Let a G B and suppose T(a) is invertible on t 2 . Then 

det M^ n (a) 

nm 1 , n 1 \ = F\a\, (13) 

n->oo G[a] n exp(^(2n)fi[a]) LJ v ' 

with some constant F[a\ and 

^ 00 

G[a] = exp([loga] ), Q[a] = - k 2 [loga} k [\oga}_ k . (14) 

k=— oo 

(b) Assume the moment condition (CI), let a G L°°(T) n Ft\, 2 if (3 > 2 or a G Fl\,p if 
1 < (3 < 2. Suppose T(a) is invertible on £ 2 . Then 

n->oo G[aJ™ 

/or a constant E(a). If further a G -F^ or a £ F£ 2 +£ , a = max{l,2//3}, e > 0, there 
is the expression 

E[a] = det (T(a- l )M^a)^ . (16) 



The convergences in (T3\) and (To]) is uniform in a on compact subsets of the function spaces. 

The assumption that T(a) is invertible is a natural assumption on the symbol; it is 
the condition in the (scalar) Szego-Widom theorem (see [31 Ch. 10], and [22] )■ One of 
the general versions of that theorem pertains to symbols drawn from the Krein algebra 
K = L°°(T) n Fl\, 2 (which contains discontinuous functions). Hence, at least for > 2, we 
achieve the same level of generality. 

Except for the Krein algebra K, the various classes of symbols occurring above are Banach 
algebras continuously embedded in C(T). For those classes, the assumption on a is equivalent 
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to requiring that a possesses a continuous logarithm on T, which then enters the definition 
of the constant G[a] and Q[a\. In case of K, we must define 

G[a] = [T-V^loo (17) 

as the (0, 0)-entry in the matrix representation of the inverse Toeplitz operator, as is well 
known in the context of the classical Szego-Widom theorem. 

The quite technical assumptions in ffl2|) can be simplified in special situations such as 
(HDD. Then l^x) = 0^1 (1/2 < < 1) or l^x) = ^f^ (0 = 1). Consequently, in 

case 1/2 < < 1 we can take B = F£ 2 , while in case = 1 we can take B = F£ 2 (i/), 
v m = C(l + \m\) log 1 / 2 (2 + |m|), which is only slightly stronger than one might expect. 

The theorems above are derived in Sections 6 and 7, as a consequence of a more general 
result, Theorem 14.41 (Section 4), on the asymptotics of determinants of type (jSJ). Section 3 
lays out various preliminaries required for the proof of Theorem 14.41 and also explains how 
we employ the moment assumption. Section 5 provides detailed asymptotics of a certain 
trace term occurring in Theorem 14.41 which is tied to the variance of Xf, n . 

We close the introduction by pointing out that since we focus on angular statistics, it 
is the same to consider fixed reference measures dfi(r) as it is n-dependent measures of the 
form dfi n (r) = dfi(c n r) for some scale factor c n . There are though examples of interest which 
fall out of this set-up. For instance, there is the spherical ensemble connected to A~ l B in 
which A and B are independent n x n Ginibre matrices. The resulting eigenvalues form 
a determinantal process with dfi n (r) = r(l + r 2 )~( n+1 W [13]. Another example are the 
roots of the degree- n complex polynomial with Mahler measure one, for which dfi n (r) = 
r min(l, r~ 2n ~ 2 )dr [1]. Our methods could perhaps be adopted to both situations, but we do 
not pursue this. 

2 On the moment condition 

Of the key examples, both CUE and truncated Bergman satisfy (lnm^)" = 0(£~ 2 ), while the 
Ginibre ensemble satisfies (lnm^)" = 0(£ -1 ). A few more illustrative examples are contained 
in the following. 

Proposition 2.1 Consider positive measures on M. + with density dfj,(r) = n(r)dr and cor- 
responding moment function = J °° r^fi(r)dr. 

(i) If fi(r) is supported on a finite interval [a,b], and is "regular" at b as in /x(r) = 
c(b — r) a_1 for r G (b — 5, b] and a > 0, then (lnm^)" = a£~ 2 + 0(£~ 3 ). 

(ii) If fi(r) = p(r)e~ cra for polynomials p and a > 0, then (lnm^)" = a:£ -1 + 0(£~ 2 ). 

(Hi) If /i(r) = e~ c( - lni - e+r >> for q > 1, then (lnm^)" = a£<?-i + 0(£ i- 1 ) upon choosing 
c = a 1 -9( 9 1 /(i-9) - g«/(i-9)). 
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Proof. We start with explicit instances of cases (i) and (ii). For (i), there is no loss in 
assuming that [a, b] = [0, 1] and we consider further //W(r) = (1 — r) a_1 l[ 0j i]. For case (ii), 
consider a simple polynomial term ^'"'(r) = r p e~ ra . Then we have, 

In mf = In r(f + 1) - In r(f + a + 1) + In T(a), 

and 

] 1 ! I i ^ 

ti titr kn n r\ wi ir\ \ r\\- r\r\ \rw r niv^ r\T "f~ ri /"> o r»T\r mrin I . . , , , 

dz 2 



lnm^ = lnr((£ +p + 1)/ck) — In a. 
From this point the verifications may be completed by use of the appraisal -A- In T(z)=z~ l 



(1/2) 2 2 + 0(z 3 ), valid for large real values of z. 
More generally, for case (i) we write 

and note that Laplace asymptotic considerations yield: for d = 0,1,2, ((log r) d r^) M = 
((logr) d r^) M (i) + 0(e~ Cs ^), which is more than enough to show that one has the same asymp- 
totics for any such /x as for fi®. That (ii) extends to more general polynomials p(r) is 
self-evident. 

For case (iii) we only mention that it is most convenient to consider the asymptotically 
equivalent object mg = j^°e^ r ~ crq dr (after an obvious change of variable) for which the 

leading order arises from a neighborhood of the stationary point r* = (£,/cq)~ . The details 
are straightforward. □ 

The above is intended to be illustrative; no attempt to optimize the regularity conditions 
on \i has been made. We also mention here without proof that the measure d/i(r) = e _e ' dr 
produces a moment sequence for which there is the not strictly polynomial decay (lnm^)" = 
O(-^j). Further, by Fourier inversion, one may produce measures for which (logm^)" is 
exactly a(l + for < < 2, /3 + 1, a > 0. 

Moment condition and the mean measure Our condition(s) on the moment sequence 
also dictate the limit shape of the mean measure of the points. This object is given by 



' I \ z ]2k \ 

where d 2 z denotes Lebesgue measure on C, and as the name suggests E m ri [# points in A] = 
n J A dA n (z) for (measurable) A CC, see again [TT]. We provide one description of the shift 
from a "/3 = 1" setting, resulting in an extended limit support, to a "/3 > 1" setting for 
which the limit support is degenerate. This is in line with the conjecture discussed after 
Theorem 11.21 
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Proposition 2.2 For all sufficiently large £ let the moment sequence mg = J °° r^d[i(r) 
satisfy 

Game)" = ^- + 6(0 (18) 

TOi/i a > and e G L 1 (M + ). Then there exists a rescaling of P mjTl so i/iat <iA n converges 
weakly to either: a weighted circular law with density 2^jM" -2 071 \ z \ — 1 when a > 0, or 
to the uniform measure on \z\ — 1 u>/ien a = 0. 

Note, £ is necessarily nonnegative when a = 0. And of course, when a = 1/2 the 
advertised limit is the standard circular law (see e.g. pQ). 

Proof. Choose q ^> 1 so that (fT8|) is in effect for s > q, and then integrate the equality 
twice: first over q < s < t, and then in t from k to k + £ to find 

ln /mfc+A = ^ogjfc + ^ + om ( 19 ) 
V m k J 

(Here c = (lnm)'(g) + alnm(g) — J°° e(s)ds, and the o(l) holds in k — we view £ as fixed). 
Next compute the I th absolute moment in the mean measure: 

f \ z fdA n (z) = -y^ = -e ce yk a£ (l + o(l)). (20) 

Neglecting the multiplicative errors, in the case a = the sum (1201) converges to e rf for any 
£, unambiguously the moment sequence defined by placing unit mass at the place e c G M+. 
When a > 0, we rescale P m) „ by sending {2j}i<j< n h-> {n -0 ;^}^^^ Then, the sum becomes 
e cl lY.lZ\(k/n) al -> ^ as n oo. Matching constants in t e d{t/b)P +1 = ^^b 1 
identifies (uniquely) the scaled a > moment sequence with that of the measure with 
density f{t) = (p + l)t p /b p+1 on [0,6] where b = e c and p = Thus the limit mean 

measure (or actually its radial projection) is also identified. In either case, a > or a = 0, 
an additional rescaling will pull the edge of the support from e c to 1. □ 

3 Hilbert-Schmidt and trace class conditions 

Our results hinge on being able to consider M M (a) as a suitable compact perturbation of the 
Toeplitz operator T(a) (see ffTT]) ). Here we will establish sufficient conditions on a and fi 
such that 

K„(a) = M^a) - T(a) = (fe - l)%- fc )) , j,k > 0, 

is Hilbert-Schmidt or trace class operator. We refer to [9] for general information about 
these notions. Since T(a) is bounded on £ 2 whenever a G L°°(T), under the appropriate 
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conditions M M (a) is then also bounded. While it might be interesting to ask for necessary 
and sufficient conditions for the boundedness of M M (a) and the compactness of K^a), we 
think it is a non-trivial issue, which we will not pursue here. 

The compactness properties of K^(a) rely mainly on the "shape" of Qj >k near the diagonal. 
An application of Holder's inequality shows that < Qj^ < 1- More detailed information on 
Qj^k is provided by the following technical lemma, for which we use the set of indices, 

Is = { (j, k)eZ + xZ + : \j - k\ 5 < (j + k)/2 }, (21) 

always assuming 8 > 1 (Z + = {0, 1, . . . }). The factor 1/2 in 1$ is only for technical conve- 
nience. In particular, (j, k) G Is implies j, k > 1. 

Part (a) of the lemma will be used at several places, while the more elaborate part (b) 
is used only in Lemma [5.21 Part (b) obviously implies part (a), but it seems more clarifying 
to state and prove (a) separately. Throughout what follows we will utilize the notation 
a V b := max{a, b}. 

Lemma 3.1 

(a) Let > 0, 8 > 1, (35 > 2, and assume that the measure fi satisfies the condition 

(lnm € )" = 0(r /9 ), e^oo. 
Then, for (j, k) e Is with A = j — k, o = j + k, we have the uniform estimate 

Bi,k = 1 + O^V (22) 

(b) Let /3,7, q > 0, 5 > 1, 08 > 2, 7<5 > 3 ; g5 > 2, and assume that there exists a 
differentiable function h^) > such that 

(lnm f )" = M0 + O(ra e^oo, 

and 

M0 = o(r /, ) > ^(o = o(r y ), e^oo. 

Then, for (j, k) e Is with A = j — k,a = j + k, we have the uniform estimate 

A 2 /A 4 |A| 3 A 2 \ , . 

q» = 1 -T /l > ) + °(^ v ^ v ^j- (23) 
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Proof. We can assume without loss of generality that A > 0. Then 

lnm CT+A +lnm CT _ A A 2 . ±A , 

mg j)k = lnm CT = — -(lnm,) , r] E {a - A, a + A), 

after applying the mean- value theorem twice. We can write r\ = a(l + r), where the error 
term r is estimated by |r| < |A|/cr < \A\ 5 /a < 1/2 using 5 > 1. 
In case (a) we can conclude that 

/A 2 \ / A 2 
ln ^ k = {^f) =0 {-^ 

Because (35 > 2 we get A 2 < a 2 / 5 < a 13 . Hence the above term is bounded and exponentiating 
yields the assertion. In case (b) we first obtain 

A 2 . . /A 2 

Now we apply once more the mean value theorem to obtain the estimate 



A 2 , x /|A| 3 A 2 \ 

In Qj k = hjjj) + O - — - V — 

Uh 2 M ' \ ere J 



Notice that, as above, rj = er(l + r) with |r| < 1/2. All these terms are bounded because 
2/5 < /3, 3/(5 < 7, and 2/5 < g. The assertion is obtained upon exponentiating. □ 

Part (a) of the lemma translates immediately into the estimates that follow. 

Proposition 3.2 Let (3 > 1/2 and assume that the measure /i satisfies the assumption 

(In m^" = 0(f p ), £^oo. 

Put o = 1/2 V 1//3. Then there exists a constant > such that K^a) is Hilbert- Schmidt 
and the estimate 

\\ K v( a )\\c 2 (f 2 ) < CJHIi^ 

holds whenever a G FC, 2 a . 

Proof. Put 5 = 2o~ = lV2//3so that Lemma [3.1( a) is applicable. The operator K^a) is 
Hilbert-Schmidt if and only if the sum ^(jfc)ez 2 l a j-fc| 2 (l — Qj,k) 2 is finite (this quantity is 
the square of the Hilbert-Schmidt norm). We have that 

U,k)eZ\ (j>k)m U,k)el s 

d 4 



|2 

„2j8 



(d, s)GZxZ + (d,s)£ZxZ + 
d| l5 >s/2 |d|< 5 <s/2 

C^|a,| 2 |rf| 5 + C^|a rf | 2 | C /| 4 ^ 1 - 2 ' 3 ). 



< 



del del 
11 



Line one just uses Qj } k G (0, 1]. In line two we make the substitution d = j — k, s = j + k 
and employ Lemma [3.1( a). and the final line uses the fact (3 > 1/2. Furthermore, as 5(3 > 2 
we see that the second term in this last line does not exceed the first one, and that in turn 
is equal to the square of ||a||^2 (5 = 2a). □ 

Next we establish two sufficient conditions for K^(a) to be trace class. It is not hard to 
show that one is not weaker than the other, i.e., neither of the two function classes pointed 
out below is contained in the other. 

Proposition 3.3 Let (3 > 1 and assume that the measure \i satisfies the assumption 

Put a — 1 V 2//3. Then there exists C M > and, for each e > 0, > such that 

(a) Kn(a) is trace class and the estimate 

11^(0) || Cl (P) < CJIal 

holds whenever a G Ft\; 

(b) K^(a) is trace class and the estimate 

||^(a)||ci(^) < CV,ell a lli^_ 

holds whenever a G F£* +e . 

Proof. Here we put 5 = a = 1V2//3 and notice that then Lemma IBTTT a) is again applicable. 

(a): We first estimate the trace norm of K^t" 1 ), m G Z. Without loss of generality 
assume m > 0. Then K^{t m ) has entries on the m-th diagonal given by {gk+ m ,k ~ ^}Z=o- 
This operator is trace class if and only if its trace norm 

00 

\ 0k+m,k - 1| < OO. 

fc=0 

We split and overestimate this sum by a constant times 

,2 



<T + £ 



E 1+ E 



m 



(2k + m)^ 

(k+m,k)^l s {k+m,k)£_T s v ' 

using Lemma \3. 1( a) for the second part. Now (k + m,k) G Is means that m 5 < (2k + m)/2, 
i.e., 2k > 2m s — m. Noting that 2k < 2m 5 — m implies k < m s , and 2k > 2m s — m implies 
2k > m s , the previous terms are overestimated by 



2 



E 1+ E < m s + Cm 2+s ^ < (1 + C)m 

0<k<m 6 k>m s /2 
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Here we used j5 > 1 and 5(3 > 2, and all estimates are uniform in m. Thus || (t"^") || Ci (^ 2 ) — 
0(|m| 5 ). From here the proof of (a) follows immediately. 

(b): Introduce the diagonal operator A = diag ((1 + /c) -1 / 2_E ), e > 0, acting on £ 2 . As A 
is Hilbert-Schmidt, and it suffices to prove that the operator with the matrix representation 
of i^(a)A _1 is Hilbert-Schmidt. The squared Hilbert-Schmidt norm of i^(a)A _1 equals 

\a^ k \ 2 (l + k) 1+2 %l-g^ k ) 2 . 

As before we split the sum into two parts, 

£ \a^ k \ 2 (l+j + k) 1 ^+ l^| 2 (l-^) 2 (l+J + ^) 1+2£ > 

(J,k)£L s (j,k)ei s 

slightly overestimating it further. Now we make the substitution d = j — k e Z and 
s = j + k G Z + . We arrive at the upper estimate for the first term 



M 2 (i + *) 1+2£ < cJ2 M 2 (i + \d\) S{2+2£) < c\ 



|2 

\F£- 



(d,s)6ZxZ + dez 
\d\ s >s/2 



<5(l+e) 



For the second term, employ (1 — Qj, k ) 2 < C (j ' — k) 4 (l + j + k) 2/3 , by Lemma [3.1( a). to find 
that it is bounded by a constant times 

El |2 (j ~~ ^) 4 |2 ^ 

(1+7+ fc)2/3-l-2e " ^ (l + S )2/?-l-2e- 

d|' 5 <s/2 

Without loss of generality we could have chosen e > small enough such that /3 > 1 + e. 
Then we can estimate further by a constant times 

£ |a d | 2 |rf| 4+5 ( 2+2£ - 2 « < M 2 M 5(2+2£) < IMI«» W 

del del 

This proves the assertion. □ 

Remark. The condition /3 > 1 is (in a certain sense) necessary to ensure that K^(a) is 
trace class. More precisely, assume that the measure fi satisfies the condition 

(lnm ? )" = ^ + 0(r e ), ">0, 1/2 < f3 < 1, e > /3. (24) 

Choose 6 > 2/P > 1. Using Lemma l37iT b) it follows easily that 

<*U - k) 2 

2(1 + j + ky 
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for indices (j, k) G Is- Moreover for each fixed m, the entries (k, m + k) belongs to T$ for all 
sufficiently large k > ko(m). Thus the m-th diagonal has entries 

2 

CXTfl 

a m {Qk,k+m - 1) = a m7^-< 1 oMfl ( 1 + k - fc o(w)" 

2(1 + m + 

This growth (in k) is too large to allow K^(a) to be trace class unless ma m = 0. That is, 
under (}24"1) . the operator K^a) can only be trace class in the trivial case of constant symbol. 



4 Determinant asymptotics 

Recall that given a function a £ L°°(T) with Fourier coefficients a n , the Toeplitz and the 
Hankel operator are defined by their infinite matrix representations 

T(a) = (%_*), if(a) = (oj+jt+i), < j, < oo. (25) 

It is well known that the relations 

T(ab) = T(a)T(b)+H(a)H(b), (26) 
H(ab) = T(a)H(b) + H(a)T(b), (27) 

hold, where b(t) = tel. For later introduce the flip and the projections, 

W n : {x , Xi,...}\-> {x n _i, . . . , x , 0, 0, . . . }, 
P n : {x , x u . . . } {x , • • • , ar n _i, 0, 0, . . . }, 

Q n = I — P n , and the shift operators V n = T(t n ), n E Z. 

Consistent with previous notation, we denote by T n (a) and M jU>n (a) the n x n upper- left 
submatrices of the matrix representation of T(a) and M M (a), ie., 

r n (a) = P n T(a)P n , M Mi „(a) = P n M u (a)P n . 

Here we identify the upper-left n x n block in the matrix representation of the operators on 
the right hand sides with the C nxn matrices on the left hand sides. 

In this section we are going to establish the main auxiliary result (Theorem 14.41) . which 
reduces the asymptotics of the determinant detM (U) „(a) to the asymptotics of a trace (or 
already gives the determinant asymptotics up to the computation of a constant). This and 
the main results hold either for the Krein algebra K = L°°(T) fl F^\j 2 ( see [31 Ch. 10]), 
or for several subalgebras of C(T), which satisfy "suitable conditions". Therefore, it seems 
convenient to formulate Theorem 14.41 below in a quite general context and to make use of 
the following definition. 
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Definition 4.1 Given a unital Banach algebra B which is continuously embedded in L°°(T), 
denote by <&(B) the set of all a G B such that the Toeplitz operator T(a) is invertible on £ 2 . 
We say such a Banach algebra B suitable if: 

(a) B is continuously embedded in K = L°°(T) D Fl\, 2 . 

(b) If a G $(5), then a' 1 G $(£). □ 

The next proposition demonstrates the suitability of several Banach algebras which ap- 
pear in the main results. 

Proposition 4.2 With W = F£q denoting the Wiener algebra, the following are suitable 
Banach algebras: 

(i) W D Fl 2 — Ft\ for a > 1/2; 

(ii) Fl\ for cr > 1/2; 

(in) W n F£ 2 1/2 and K = L°°(T) n F£j /2 ; 

(iv) W n Fl 2 {y) provided that z/_ n = v n > n 1 ! 2 , {z/ n }^ x is increasing, and sup — < oo. 

n>i " n 

Proof. First of all, the above are indeed Banach algebras. This is elementary for Fi\. 
A proof for W n F£ 2 , a > can be found in [3], Thm. 6.54], while the more general space 
W n Ft 2 {v a ) is treated in [13]. For K see, e.g., [3J Thm. 10.9]. As for (i), note that Fi 2 a 
is continuously embedded in W whenever a > 1/2. Further, property (a) of suitability is 
immediate for these spaces. 

Recall that a unital Banach algebra B is called inverse closed in Banach algebra Bq d B 
if a G B and a -1 G Bq implies that a -1 G B. For all the Banach algebras B above, except 
for K, using simple Gelfand theory and the density of the Laurent polynomials it is easily 
seen that the maximal ideal space can be naturally identified with T. (In the case of (iv), 
this is also proved in [13].) By a standard argument, this implies that these Banach algebras 
are inverse closed in C(T), thus also in L°°(T). For a proof of the inverse closedness of K in 
L°°(T) see again [3j Thm. 10.9]. 

As for property (b), take a G $(-B), i-e., a G B such that T(a) is invertible on £ 2 . From 
the theory of Toeplitz operators it is well known that then a is invertible in L°°(T). By the 
inverse closedness we thus have a -1 G B. Now we observe that b G K implies that both H(b) 
and H(b) are Hilbert-Schmidt. Using the formulas 

I = T(a)T(a- 1 ) + H(a)H(a- 1 ), I = T{a' 1 )T(a) + ^(a^ 1 )^^), (28) 

and the implied compactness of the Hankel operators, it follows that T(a _1 ) is a Fredholm 
regularizer for T(a). (For information about Fredholm operators, see, e.g., [9].) Hence T(a _1 ) 
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is also Fredholm with index zero and thus invertible (by Coburn's lemma [3j Sec. 2.6]). But 
this means that a -1 G <&(B). □ 

The next proposition shows (besides a technical result (ii)) that the constant G[a] is 
well-defined for all a G $(-£?). This constant appears in our limit theorem as it did appear 
in the classical Szego-Widom limit theorem. We follow closely the arguments of [3j Ch. 10]. 

Proposition 4.3 Let B be a suitable Banach algebra, and a G ${B). 

(i) With [*]oo the (0,0)-entry of the matrix representation on I 2 , the constant 

G[a] := [T-V 1 )]™ (29) 

is nonzero. 

(ii) With A n = P n T- 1 {a" 1 )P n , we have det A n = G[a} n , and 

strongly on £ 2 as n — >■ oo. (A* is the adjoint of A). Moreover, the mappings 

A n : a G ^ A' 1 G C(t) 

are equi- continuous. 

(Hi) IfbtzB, then e b G &{B) and G[e b ] = e b ° , where bo is the 0-th Fourier coefficient. 

Proof. (i)-(ii): If a G <&(B), then a -1 G 3>(-B) and hence T(a _1 ) is invertible. Hence the 
definitions of G[a] and A n make sense. Notice that for n = 1, we have det A\ — A\ = 
[T _1 (a _1 )]oo = G[a]. Hence (i) will follow from the invertibility of A n in the case n — 1. 

To show the invertibility of A n we use a simple, but useful formula due to Kozak. If P 
is a projection, Q = I — P is the complementary projection, and A is an invertible operator, 
then PAP|i m (p) is invertible if and only if so is QA~ l Q\i ra ^qy In fact, the formula 

(PAP)\-i (p) = PA^P^ - PA-'QiQA-'Q^-^QA-'Pl^p) 

holds, which can be easily verified (see also [3j Prop. 7.15]). 

Applying Kozak's formula to A n = P n T~ l (a~ 1 )P n we see that A n is invertible if and only 
if Q n T(a~ 1 )Q n is invertible, and in this case we have 

A' 1 = P n T(a- 1 )P n - PnTia-^Q^QnTia-^Qny'QnTia-^Pn. (30) 

Notice that Q n T(a~ l )Q n is nothing but the "shifted" Toeplitz operator. Using V n V_ n = Q n , 
V- n V n = I, we obtain {QnT(a~ l )Q n )~ l = V"„T _1 (a _1 )VC n and hence 

A' 1 = P n T{a~ l )P n - PnTia-^VnT-^a-^V^Tia-^Pn. (31) 
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We have thus shown that A n is invertible and in particular (i). Moreover, from this rep- 
resentation it follows immediately that the mappings A n are equi-continuous. If suffices 
to remark that the operators P n and V± n have norm one, and that the various mappings 
b G ^ b~ l G $(£), be B ^ T{b) G C(£ 2 ), B G GC(£ 2 ) ^ B' 1 G C(£ 2 ) are contin- 

uous. Using that P n = P* — > I strongly, and V* = V_ n — > strongly on £ 2 , it follows that 
A^ 1 and their adjoints converge strongly 

In order to prove det P n T~ l (ar 1 )P n = G[a] n is suffices to prove that 

<HA ' = G[a] (32) 



det A 



n-l 



for n > 1. For n = 1 with det A := 1, this is just the definition of G[a\. By noting that 
A n _i = P n _iA n P n _i it follows from Cramer's rule that 

det A n _i ^ r^-ii 
detA n ~ [ n ln ~ 1 ' n - 1 

for n > 2 while the statement is obvious for n = 1. Reformulating the above expression (13T1) 
for A' 1 one step further, we have 

A- 1 = W n T{h~ x )W n - W n H(a- l )T-\a- l )H(a- l )W n = W n T~\a)W n . (33) 

Here we use the general formulas 

P n T(b)P n = W n T(b)W n , P n T(b)V n = W n H(b), V„ n T(b)P n = H(b)W n . 

as well as an identity relating the inverses of T(a~ l ) and T(a) to each other (which either 
can be derived from Kozak's formula or by using f[2T)|) . ( 12"T|) ). Due to the definition of the 
W n , we see that the lower-right entry of A' 1 does not depend on n for n > 1, i.e., 

[A;Vi,n-i = [T- 1 (5)] 00 = 1/G[a], 

the last equality following from 032]) for n = 1. This completes the proof of (152]) for all n. 

(iii): Using ( )28|) it can be seen that T(e~ Xb ) is a Fredholm regularizer of T(e Ab ), A G [0, 1]. 
Due to the stability of the Fredholm index under perturbation, all these operators have 
Fredholm index zero; hence they are invertible (Coburn's lemma [3j Sec. 2.6]). This proves 
e b G &(B). A proof of G[e b ] = e b ° can now be given via an approximation argument and by 
using Wiener-Hopf factorization (see [31 Prop. 10.4]). □ 

Before stating the main result of this section, we introduce two conditions on a Banach 
algebra B C L°°(T). 

(TC) For all a G B the operator K^a) is trace class and H-f^^Ca) ||ci(£ 2 ) < C|H|b- 
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(HS) For all a G B the operator K^a) is Hilbert- Schmidt and Hi^a) ||c 2 tt 2 ) — C||o||b- 

Propositions 13.21 and 13.31 identify Banach algebras B which satisfy the above, the criteria 
involving the underlying measure \i (the constant C depends on /i). 

Theorem 4.4 Let B C L°°(T) be a suitable Banach algebra, 
(a) Suppose B satisfies (TC). Then for a G §{B) we have 

lim = E[a) (34) 

G[a} n 1 J v ' 



n— >co 



where 



E[a] = det (ria-^M^a)^. 



The constant E[a\ is a well-defined operator determinant, and the convergence [34\ ) is 
uniform in a G &{B) on compact subsets of§(B). 

(b) Suppose B satisfies (HS). Then for a G $(-B) we have 

lim detM /-» = m a] m) 

n^ooG[a} n -exp^race P n T{ a - 1 )K l ,{a)P n ) L J 1 ' 

with 

H[a] = det (T(a- 1 )M^(a)e- T(a_1) ^ (a) 



Again, the constant H[a] is a well-defined operator determinant, and the convergence 
K35\) is uniform in a G $(-£>) on compact subsets of§(B). 

Proof. The first steps in the proof of (a) and (b) are the same. As in the previous proposition 
define A„ = P„T~ l (ar x )P„. Recall (1281) to conclude that 



T(a) = T-^a- 1 ) + L{a), L{a) := -T" 1 (a" 1 )if(a" 1 )iJ(a) 

with L(a) being trace class. The latter follows from the fact that H(b) and H(b) are Hilbert- 
Schmidt for b G B C K, while appropriate norm estimates also hold. Moreover, property (b) 
of the suitability of B implies that the mapping 

a G !-»■ L(a) G d(£ 2 ) 

is continuous. Now we can write 

M^ n (a) = P n {T-\a- 1 ) + L{a) + K^a))P n 
= A n + P n {L{a) + K ll {a))P n . 
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Using Proposition 14.3( h) we obtain 

= det ( P ™ + A n lp n(L(a) + K,(a))P n ) . (36) 

(a) : Assume condition (TC). Then K^a) is trace class, and the mapping a G 3>(a) >— >■ 
K^{a) G Ci(i 2 ) is continuous. Consequently, again by Proposition 14.3( h) . 

det (P„ + < 1 P n (L(a) + #»)P n ) 

converges to the well defined operator determinant 

det (I + T{a~ 1 ){L(a) + K^a))) , 

which equals 

det (T( a - l ){T(a) + K^a))) = det (T^^M^a)) . 

As to the uniform convergence on compact subset of $(P), it is enough to show that the 
family of maps 

a G $(£) H- det (P n + A?P n (L{a) + # M (a))P„) G C 

are equi- continuous. To see this we use the equi-continuity of a G $(P) A^ 1 G £(^ 2 ) and 
the continuity of a G $(P) i-> £( a ) + K^a) G Ci(£ 2 ) along with fact that sup UA^H < oo 
for each a G $(P). This implies that the maps 

aG $( jB )^A; 1 P n (L + ^(a))P„ 

are equi-continuous and bounded. Finally, in order to pass to the determinant we use the 
general estimate 

|det(I + A) -det(/ + C)| < ||A - C\\ x exp (max{||A||i, ||C||i}), 

which holds for trace class operators A, C. 

(b) : Now assume condition (HS). In view of (136]) introduce 

C n = A- 1 P n (L(a) + K ll (a))P n . 

Then 

C n = A- l P n L(a)P n + P n T(a- l )K^a)P n + D n 

with 

D n = {A- l P n - P^ia-^K^Pn. 
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From (I30I) and P n = I — Q n we obtain 

A- l P n - P n T{a~ l ) = -P n T{aT x )Q n - P n T{a- 1 )Q n {Q n T{a' l )Q n )- l Q n T{a^){I - Q n ) 
= -PnTia-^QniQnTia-^Q^Q^ia- 1 ) 

Using the same arguments as in the derivation of (13"Tj) and (13"3"j) . this equals 

-^ n ^(S- 1 )T- 1 (a- 1 )U_ n T(a- 1 ), 

whence 

D n = -iy n F(&- 1 )T- 1 (a- 1 )Vl n T(a- 1 )^(a)P n . 

Since H(a~ l ) and K^(a) are each Hilbert-Schmidt, and V^ n — > strongly, it follows that 
D n in the trace norm. Moreover, from the explicit representation it is seen that the 
family of mappings a G $(P) D n G Ci(£ 2 ) is equi-continuous. 

Further, by Proposition H31(ii), A^P n L{a)P n ->• T^ 1 )^) converges in the trace norm, 
and the family of maps a G $(P) i-> /L^PjL^Pi G Ci(£ 2 ) is equi-continuous. 

In contrast, P n T{a~ 1 )K fl {a)P n converges only in the Hilbert-Schmidt norm to T(a _1 )-ft' M (a), 
while the mappings a G $(P) i-> PnT^a^K^^Pn G C 2 (^ 2 ) are equi-continuous. 

We can now conclude that on each compact subset of $(P), the afore-mentioned maps 
are actually uniformly equi-continuous and uniformly bounded. Hence we have uniform 
convergence of the corresponding sequences of operators in the trace class or Hilbert-Schmidt 
norm. 

With C = T(a~ 1 )L(a) + T(a~ 1 )K l ,(a) = T(a~ l )M^a), noting that L(a) = T(a) - 
T(a -1 ) -1 , it follows that, as n — > oo, 

(I + c n )e- p " T ^ K »W p « -/->(/ + C)e- T ^ K ^ - I, 
uniformly on compact subset of $(P) in trace norm. Consequently, 

Jim det ((/ + Cn)e -P n T(a-^(a)P n ^ = + c)e -T(a-i)K,(a) ^ ^ 

also uniformly. □ 
Let us summarize what we have achieved thus far: 

Assuming the moment condition (CI), i.e., u /3 > 1", we have both the trace class condi- 
tion (TC) and the Hilbert-Schmidt condition (HS) available (see Proposition 13.21 and 13. 3p . 
The easiest way is to assume (TC) and use Theorem 14.4( a) to conclude a limit theorem. 
However, the trace class conditions are much stronger than the Hilbert-Schmidt conditions, 
and it is worthwhile to see what can be done assuming only the latter. Then we can apply 
Theorem 14.4( b). and are left with the computation of traces (which will be done in Proposi- 
tion [5J] below). While we get a better result assuming only (HS), the constant expression 
will be more complicated. 
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Assuming the moment condition (C2), i.e., "1/2 < /3 < 1", K^a) will in general not be 
trace class (see the remark at the end of Section [3]). Therefore we are left with Theorem 
14.4( b) and the computation of the traces, which in this case is more diffucult and will occupy 
most of the next section. 



5 Asymptotics of the trace 

As just pointed out, in order to make use of part (b) of Theorem 14.41 we need to evaluate 
the trace term. We distinguish between the two cases indicated above. 

The case of /3 > 1 is completely settled by the following proposition, which shows that 
the trace converges to a constant. 

Proposition 5.1 Assume the moment condition (CI), and put a = 1/2 V 1//3. Then, for 
a,b e Ft\, we have 

trace (P n T(b)K„(a)P n ) = r^a, b) + o(l), n ->• oo, (37) 

where 

oo 

r^(a,6) := ^ b^a^g^ - 1). (38) 

j,k=0 



The series / fffgj) converges absolutely. Moreover, the convergence (31) is uniform in (a,b) on 
compact subsets of Fl 2 a x Fl\. 

Proof. By Proposition 13.21 the operator K^(a) is a Hilbert-Schmidt and hence bounded and 
linear. Consequently the trace equals 

oo n—1 

trace (P ri T(6)K At (a)P Jl ) = ^ ^ h-j0.j-k(Qj, k ~ !)■ 

j=0 k=0 

We claim that the estimate 

oo 

Y \h-jaj-k(Qj,k ~ 1)1 < C||a|| F ^||6|| F£ 2 (39) 

j,k=0 

holds. Indeed, put <5 = 2<r = lV2//3, recall < q^k < 1, and split the sum into 

\bk-jaj-k\+ Yl \ b J-k a j-k(Qj,k-l)\, 
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where T$ is defined in (I2T]) . Using Lemma [3.1( a) and substituting m = j — k and £ = j + k 
we can overestimate this by 



2 



(m/)GZxZ + (m,()6ZxZ + 
2|m| l5 >f 2|m|' 5 <^ 



m Ct m \Tfl\ 



From Cauchy's inequality and since 5(3 > 2, we obtain (1391) . 

The convergence (l37j) of the trace now follows from (|39|) by dominated convergence. 
The absolute convergence of (1381) is also a consequence of (1391) . Finally, again by (139]) . the 
mappings 

A n : (a, b) E Fi\ x ^ trace (P n T (b) K ^(a) P n ) , n > 1 

are equi- continuous. Convergence and equi-continuity imply the uniform convergence on 
compact subsets. □ 

We remark that the function 7^(0,6) is bilinear and continuous in a, b G F£ 2 . Formally 
r M (a, b) equals the trace of T(b)K^(a), though note the assumptions made in the proposition 
are not sufficient to insure T(6)ii" M (a) is trace class. Indeed, there exists a e F£ 2 such that 
K^(a) is not trace class (and one can choose 6 = 1). Of course, if K^a) is trace class, we 
have equality (and the proposition is a triviality). 

Now we turn to the case 1/2 < (3 < 1, for which the trace does not converge to a 
constant. It provides the second order asymptotics of the det M M „(a). In terms of the 
random matrix interpretation, the asymptotics of the trace gives the shape of the variance 
for the corresponding linear statistics. We begin with the following estimate. 

Lemma 5.2 Assume the moment condition (C2), and put 5 = 2a = 2/(3 V 3/7. Then for 
a,b e F£l it holds 



. 00 

trace {P n T(b)K^a)P n ) = ^ m 2 b_ m a m p^ m + E x (a, b; 5) + o(l), n -> 00. (40) 
Here E\ is constant and 



2 

m=— oo 



P ( nl= E' M*)> ( 41 ) 
2\m\ s <e<2n 

where the prime indicates that the summation is taken over all £ £ Z + with the same parity 
as m. The convergence [JW ^ s uniform in (a,b) on compact subsets of F£ 2 x F£ 2 . 

Proof. As in the previous lemma, the operator K^(a) is Hilbert-Schmidt and the trace 
evaluates to 

00 n— 1 

trace (P n T(6)ir At (a)P n ) = y]y]b k -jaj-k{Qj,k ~ !)• 

j=0 fc=0 
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We can split the double series into 

2j bk-jaj-kig^k - 1) and 2J fo fe-j a i-fc(^,fe ~ *)> ( 42 ) 



where the first term is dominated by 

\h-jaj-kl < C\\a\\ Fe 2\\b\\ Fe 2. 

amis 

Consequently, the first term in (|42p converges as n — > 00 to the constant 

Yl b k-j a J-k(Qj,k - 1), (43) 

and using equi-continuity we see that the convergence is uniform on compact subsets. 
For the second term in (j4"2"l) we bring in the estimate of Lemma [3.1( b). 

m 2 , . „. ^ /m 4 Iml 3 m 2 \ , , . _ 

together with the substitution £ = j + k,m=j — k. As to the applicability of this lemma, 
note that 5g > 5 > 2/ f3 > 2. Hence the second term in (|4"2"]) equals 



Er 777,2 7 /«\ \ -* , ^f mi I 777 ! 3 m2 \ 
b- m a m — h li {£) + 2^ & — a m O I ^ V — V— I 



(44) 



(i,fe)6i a (j,*0ez 4 

fc<n fc <n 



The error term here can be overestimated by a constant multiple of 

£ |6_ m a m | • (|m|W- 2 « V |m| 3 +^) V \m\ 2 + s ^) < \\a\\ m \\b\\ m . 

Here, we first converted the sum over (J, k) to that over (m, £) G Z x Z + restricted to 
21ml* 5 < £ and then summed over the £ variable. After this one notes that our conditions 
imply that the exponents 4 + 5(1 — 2/3), 3 + 5(1 — 7), and 2 + 5(1 — g) are all less than 5 = 2a. 
In other words, the error in (j44j) is dominated by a corresponding absolutely convergent 
series. As such it converges to the constant 

g jik - 1 + — h^i) J (45) 

as n — > 00. In fact, the convergence is uniform on compact subsets of Fl\ x -FY 2 , which can 
be most easily seen by equi-continuity. In view of what follows, the constant E\{a,b,S) is 
now identified as the sum of (j4"3"j) and (jl5|) . 
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Turning to the first term in ( 14"4"|) . the summation expressed in terms of (m,£) G Z x Z + 
is over all indices such that £ < 2n + m, 2\m\ s < £, and such that the parity of £ and m is 
the same. That is, what we have for the leading order is 



b-naj^ [ £)' K{t) ) (46) 

2\m\ s <£<2n+m 



2 

m=—oo 



while 

,2 



2|m| 4 <£<2n 



2 

m=— oo 



is what is claimed in (l4"0j) . 
We next show that 



E' ™XM- E' m ^W = °(^ v ^r) 



(4£ 



2|m|' 5 <^<2n+m 2|m| 4 <£<2n 



as n — > oo, uniformly in m, where e = /3 + l — 3/<5>0. This will imply that the difference 
between (1461) and (1471) converges (uniformly) to zero as n — > oo. 
To see PH|) we distinguish four cases: 

1. m > and 2|m| 5 < 2n. Then s n)m = 0(m 3 /n^). Since m < n 1 / 5 we have 

m 3 ^ m s n ( 3 - 5 )/ s m 5 

n P — n P n s 

in case 5 < 3, while the bound is m s jwP in the case 5 > 3. 

2. m > and 2n < 2|m| 5 . Then s„ jm = 0(m 3 /m /3<5 ), and since m > n 1//<s , we have 

m 3 m s m s m s 



< 



3. m < and 21ml* 5 < 2n + m. Then s rajm = 0(\m\ 3 / (2n — \m\)P), \m\ < [n — \m\/2) 1 ^ < 



n 1 / 5 , and we have 





rn 


3 


(n — 


\m\/2Y 



m 


5 (n - | 


m |/ 2 )(3-5)/<5 | 


rn 


8 


(n — 


\m\/2)P (n- 


\m\/2Y 



< — T , ' 7. = < 



\m 



5 



in case S < 3, or \m\ s /(n — n 1//(5 /2) /3 in the case S > 3. 
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4. m < and 2n + m < 2\m\ 5 . Then s n>m = 0(|m| 3 /|m| /3<5 ), n < \m\ s + |m|/2 < 21ml 5 , 
and 



\m 


3 


m 


<5 


\m\ 


/3<5 


m 


1,35+5-3 



— jyB-\-\— 3/<S 



From here it follows that difference of (1461) and (j47j) is bounded by a constant multiple 
of nT eA/3 1| a||j?£2 ||6||i?£2 , and the indicated convergence is uniform in (a, b) even on bounded 
subsets of Fi\ x Fl 2 a . The proof is finished. □ 

Next we estimate the leading term from the previous lemma. 

Lemma 5.3 Assume the moment assumption (C2), and define pnln for 5 > 1 by ( fT?) ]. 
(i) IfceW = Fl x , then 

oo oo 

c ™Pn] m = i ^ 2n ) £ c m + o(^(2n)), n^oo. (49) 

m=— oo m=— oo 

(lij // c G F£ 1 (z>) TOi/i i> m = 1 + 6 M (2|m| <5 ) ; £/ien ; wi/i some constant Ei, 

oo oo 

E CmPS ) ro = V( 2 ") E c m + £ 2 (c;5) + o(l), ?woo. (50) 



m=— oo m=— oo 



T/ie convergence holds uniformly in c on compact subsets ofW and F£ 2 (£>), respectively. 
Proof. First set 



E 



l<f<a; 



(-1)*=±1 

Standard estimates using the assumptions on /i M and the fact that the functions s^(x) are 
increasing gives s^(x) = i^{x) + C± + o(l) as a; — >• oo for constants Cj-. Granted this, for 
either point (i) or (ii), we split the sum over even and odd indices. In particular, 

E CmP ( nl = E c m max{0, S +(2n)- S +(2|m| 5 )} 

m even m even 

= s+(2n) c m - c m min{ S +(2n), S +(2|m|' 5 )}. 



m even m even 



The first term on the right hand side gives one half of the leading asymptotics. Next we 
show that for part (i), the second term is o(s+(2n)), while for part (ii) the second term is a 
constant plus o(l). 
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Indeed, for part (i), we write the second term as 

+ [ s+(2\m\ s ) 

s+(2n) c m mm \ 1, 



s+(2n) 



This renormalized series is dominated by the series Yl \ c m\- Moreover, for each fixed m, the 
minimum converges to zero as n — > oo. Dominated convergence then implies that the series 
is o(l) as n — » 00. Similar considerations can be carried out for the odd term, concluding 
the proof of part (i). 

As for part (ii), take again the even terms: 

c m min{ S +(2n), S +(2|m| 5 )}. 

m even 

This sum is now dominated by (a constant times) 

00 

\cm\ (1 + V( 2 H 5 )) < 00, (51) 

m=— oo 

while for each fixed m, the minimum converges to s~^(2\m\ 5 ) as n — > 00. So dominated 
convergence yields that the above equals 

£ c mS +(2|m| 5 ) + o(l). 

m even 

The terms involving the summation over odd m give a similar contribution, and collecting 
everything we arrive at, in case (ii): 

= £ c m «(2n) - <(2|m| 5 )) + £ c m fc(2n) - ^(2|m| 5 )) + o(l). 

m even m odd 

From here the constant 

00 ^ 

E 2 (c;S) = C + £ C m + C- £ c„»- £ c m £ /i M (£) 

m even m odd m=— oo l<£<2|m|' 5 

is identified. The uniform convergence on compacts is seen by using the equi-continuity of 
the corresponding mappings. □ 

We now combine the previous two lemmas into the following theorem. Notice that part 
(i) will be used to prove Theorem 11.1] while part (ii) is used to show Theorem 11.3( a). 
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Theorem 5.4 Assume the moment condition (C2), and put a = 1//3 V 3/(27). 
(%) If a,b £ F£ 2 a , then 

trace (P n T{b)K^a)P n ) = ft(a, 6) • 6 M (2n) + o(^(2n)), n ->■ 00, (52) 

1 00 1 /.27T 

n(o, b) = ~- m2a mb- m = / a'(e ft )&'(e ft )*» 

m=— 00 ^ 

and the convergence ( f5,8j) uniform in (a,b) on compact subsets of F£ 2 x -F^ 2 . 



(iij Lei S = D F£ 2 (z/) tuit/i 2/ m = ^1 + m%(2|m| 2ff ). T/jen, /or a,b e B, 

trace (P n T(b)K^(a)P n ) = tt(a, b) ■ t M (2n) + C M (a, 6) + o(l), n^oo, (53) 

a certain constant C^(a,b) . The convergence / f5^j) zs uniform in (a,b) on compact 
subsets of B x £>. 

Proof. (i): We employ Lemma 15.21 and Lemma l5.3( i) with c m = m 2 b_ m a m and 5 = 2a. 
Since a > 1/(3 > 1, we obtain from Cauchy-Schwartz that c 6 — W. Hence 

trace (P„T(6)^(a)P n ) = ^ c m + o(^(2n)), n -> 00, 



m=— 00 



with the convergence being uniform in a,b on compact subsets of Ft 2 a . The computation of 
the constant Q(a, b) is straightforward. 

(ii): Lemma 15.21 is applied without any change. This produces the constant factor E% 
which could be neglected in case (i). Lemma loTST ii) is now applicable because a,b G F£ 2 (is) 
along with Cauchy-Schwartz implies that c G F£ l (i>). We thus obtain the asymptotics (IBTJ)) . 
Combined with Lemma 15.21 we arrive at (153 j) with the overall constant evaluated from 
and i?2, 

C M (a, b) = 22 h k-j a i-k ( Qj,k - H 2 + ^ ) 



j,fc=0 

^ m 2 a m b- m ^~ ^ m 2 a m b- m . (54) 



m odd 



The constant C± were defined at the beginning of the proof of Lemma 15.31 The absolute 
convergence of the above series is, among other things, guaranteed by estimates on a m and 
b m that follow from the choice of B. □ 
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6 Limit theorems: the case (3 > 1 (CI) 



We are now going to give the proof of the main results stated in the introduction in the cases 
where the moment condition (CI) is fulfilled, i.e., (3 > 1. 

As already pointed out at the end of Section HJ we can proceed in two ways, by using 
either Theorem 14.41 (a) or (b) depending whether we have the trace class (TC) or Hilbert- 
Schmidt (HS) condition available. Sufficient criteria for these condition to hold are identified 
in Propositions 13.21 and 13.31 We start with the proof of Theorem 11.3( b) . 

Let us first proceed the simpler way. Put B = Fl\, or B = F£ 2 r+e , e > with a = 1V2//3. 
Then Proposition 13 .31 implies that B satisfies the trace class condition (TC), and Proposition 
14.21 shows that the Banach algebra B is suitable. Now apply Theorem 14.4( a) in order to get 
f[T5"j) in Theorem 11.3( b). In particular, we obtain the correct identification of the constant 
E[a] as a well-defined operator determinant. As for the constant G[a], see Proposition I4.3( i) 
and (iii), noting that (because B C C(T)) formula (|29|) reduces to (fill) . 

Proceeding the other way, put B = L°°(T) n F£\ /2 (fi > 2) or B = F£\ /p (1 < < 2). 
Again suitability of B is guaranteed by Proposition I4.2[ and Proposition 13.21 implies (HS). 
Now we can use Theorem 14.4( b). and we are left with the asymptotics of the trace, which is 
settled by Proposition 15.11 We obtain the same convergence ffl5|) in Theorem 11.3( b) under 
the stated (more general) conditions, but the constant E[a] must be identified as 

E[a] = e^ (a '° _1) det (T(a~ 1 )M M (a)e- T(a " 1) ^ (a) ) . 

Clearly, if a satisfies the stronger conditions, then both expressions for E[a] coincide (see 
also the remark after Proposition 15. ip . This concludes the proof of Theorem II .3( b). 

For our random matrix application (Theorem II. 2p . the behavior of the (centered) linear 
statistic Xf >n — nf = X/_/ 0i „ is accessed through considering symbols a\ = e tX ^~^ . Notice 
that Proposition I4.3( iii) implies a A e &(B) and G[a\] = 1. Applying what we have just 
proved (Theorem 11.3( b)) and we immediately obtain 

lim E m ,„ [ e ^(x f , n -n f0 ^ = A) (55) 

n— »oo L J 

with 

E(f, A) := e T "KV*) det (r(a^)M^a x )e- T(a ^ )K ^ a ^ (56) 

under the conditions stated in Theorem 11.2( a). The convergence fl55l) is locally uniform in 
A. Hence E(f, A) is analytic in A and E(f, 0) = 1. This implies that E(f, A) is a proper 
moment generating function, and hence Xf jn — nfo converges in distribution to some random 
variable Z. That Z has mean zero can be seen by differentiating (1531) and putting A = 
This concludes the first part of Theorem 11.21 



28 



Notice that under the stronger conditions, the constant simplifies to 

E(f, A) = det ^T(e- iA(/ - /o) )M M (e iA(/ - /o) )) = det (V^^M^e^)) . (57) 

What exactly Z is though is hard to understand from (|56|) or (|57|) . The following is the best 
we have; it completes the proof of Theorem 11.21 

Proposition 6.1 Let f3 > 1, a = 1 V 2/(5 and assume either b G Fl\ or b G Fl 2 a+e , e > 0. 
Then there exists 5 > such that for A G C with |A| < 5 holds that 

/A 2 00 \n N 

det(T(e- A,, )M /t (e Afe )) = exp [— trace {H{b)H{b)) + ^ ^[ trace ( B n) ) , (58) 

where the (trace class) operators B n are defined by the recursion 

B n+1 = M^{b n+1 ) - J2 Q B n+l _ k M,{b k ), n > 0. 

Ahead of the proof, we write out the first couple -B„'s. With M k = M M (6 fc ) we obtain 
B 1 = Mi, 

5 2 = M 2 -M 2 , 

5 3 = M 3 - 2M 2 Mi - MiM 2 + 2Ml, 

5 4 = M 4 - 3M 3 M! - .U;.U 5 - 2M 2 + 6M 2 M 2 + 3M 1 M 2 M 1 + 3M 2 M 2 - (i.U ; . 

When /x is the unit mass at 1, then M M (6) = T(b) and one has that logdet(T(e _A6 )T(e Afe )) 
equals A 2 trace (H(b)H(b)) (according to the Szego-Widom limit theorem). That is, we have 
the above expressions with M k replaced by T k = T{b k ) while at the same time trace 5 2 = 
trace (H(b)H(b)) and trace B m = for all m > 3. (This means that the cumulants of Z of 
order three and higher are vanishing.) Back in the general case, we can subtract from the 
B k given by the above formulas the corresponding expressions for the special case M k = T k 
and then take traces. Substituting M k = T k + K k with K k = K(b k ), yields 

trace (B 2 ) = trace (H(b)H(b)) - trace (2T 1 K l + K 2 ), 

trace (B 3 ) = -3 trace {K 2 T X + i^iT 2 + K 2 K 1 ) + 2 trace (3if 2 Ti + 3K{r 2 + K\) , 
trace (5 4 ) = -4 trace (Tgi^ + K Z T X + K 3 K X ) - 2 trace (2T 2 K 2 + K\) 

+ 12 trace {T 2 T X K X + T 2 K X T X + T 2 K\ + K 2 T 2 + K 2 T X K X + K 2 ^iTi + i^/q 2 ) 
- 6 trace {43%K X + 4ZfKf + 2T X K X T X K X + + K\). 

All products under the traces are trace class operators and thus each of the above objects can 
be computed explicitly in terms of infinite sums. Still, the expressions become increasingly 
intractable, and we do not see how further simplifications are possible. 
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Proof. Set a\ = e Xb and split the determinant E[a\] = detT(a x 1 )M fM (a\) into two parts 
E[a x ] = E 1 (X)E 2 {\) where 

Ei(X) = detT(a^ 1 )e AT(6) , E 2 (X) = det e - AT ^M M (a A ). 

First of all, both expressions are well defined because the expressions under the determinant 
are of the form identity plus trace class. Indeed, this has been shown for T(a~ x 1 )e XT<yb ^ in [51 
Prop. 7.1]. Now observe that M^(a\) is a trace class perturbation of T(a\). 
It has been shown in 0, Sec. 3] (see also the proof of Thm. 2.5 in j2]) that 

/ \2 

Et(X) = exp I ytrace (H(b)H(b)) 

It is straightforward to verify that E 2 (A) depends analytically on A (see again [5j E]). 
Assume now that |A| is sufficiently small such that M^(a\), being close to the identity 
operator, is invertible and hence the determinants E 2 (X) are nonzero. Notice that E 2 (0) = 1, 
whence there is no problem of defining a logarithm in a small neighborhood of zero, 



/(A) :=logdete- AT WM M 



ax)- 



Recall that for invertible analytic operator-valued functions F(X) of the form identity 
plus trace class we have the well-known the formula (log det F(X))' = tra.ce F' (X) F^ 1 (X) . As 
a consequence, for invertible A(X) and B(X), whose product is identity plus trace class, we 
have 

(log det A(X)B(X))' = trace ^ 1 (X)A , (X) + B f (X)B- 1 (X)^j . (59) 
From this we obtain 

/'(A) = trace (M,(a x )' M;\a x ) - T(b) 



For small |A| introduce the well-defined analytic function B(X) defined by B(0) = and 

B'(X) = M^a x )'M;\a x ). 

Writing out this relation in terms of power series (with B(X) = Y^k=i^ Bk/k\) it follows 
that 

X k B k+1 \ X k M,(b k ) \ _ ^ X n M ll (b n+l ) 

\k=0 / \k=0 / n=0 

Inspection of the n-th coefficient (n > 0) produces 

M^b n+1 ) = B n+1 + (^jB n+1 _ k M^b 
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which implies the recursion. Noting that /(0) = 0, B(0) = 0, and /'(A) = trace (B'(X)—T(b)) 
yields 

E 2 (\) = dete- AM " (fe) M M (a A ) = exp(trace (5(A) - AT(6))). 

Since we have i?i = M M (6) from the recursion and trace K^ib) = (gkk = 1) the proof is 
finished. □ 



7 Limit theorems: the case 1/2 < (3 < 1 (C2) 

We will now prove the main results of the introduction related to the moment condition 
(C2). 

Let us first prove Theorem 11.3( a). Put B = F£ 2 (u) with the conditions on v stated 
there. It follows immediately that B C F£ 2 with a > 1/(3 > 1. Hence by Proposition 13. 21 the 
Hilbert-Schmidt condition (HS) holds. Moreover, Prop osit ion 14 . 2 1 implies that B is a suitable 
Banach algebra. Hence we can use Theorem 14.4( b) and obtain (I35p with the constant H[a]. 
We are left with determining the asymptotics of the trace of P n T(a~ 1 )K^(a)P n , for which 
we can use Theorem I5.4( ii). Therein our Banach algebra is continuously embedded into the 
Banach space F£ 2 a f\F£ 2 {y) (with possibly different v). With b = a^ 1 the asymptotics equals 
Cl(a, a" 1 ) • Ln(2n) + C^(a, cr 1 ) + o(l) with 

1 [-27T 1 /.27T / n '( p it)\ 2 

nW:=n( a , -') = -- J f a'(e«)(a-(e"))'* = -y o (^) *. 

This gives the correct constant in (1141) . As for the constant _F[a] in f|T3|) we remark that 

F[a] = e c - (a ' a_1) det (^T(a- 1 )M M (a)e- T(a " 1) ^ (a) ) (60) 

where C M (a, a -1 ) is given by (154"]) . but we make no attempt to simplify the expression. 

Notice that both Theorem I5.4( ii) and Proposition |4.2( iv) require the rather complicated 
Banach algebra B = F£ 2 (u). This completes the proof of Theorem 11.3( b). 

Let us now turn to the proof of Theorem 11.11 We assume that B = F£ 2 with a = 
1//3 V 3/(27). There is no change in the applicability of Theorem 14.4( b). however, the 
function to which we apply it is appropriately re-scaled. In particular, it depends on n, and 
therefore the statements about uniform convergence are needed. 

Let us first point out that the mean of X^ n is precisely nf and the variance is asymptot- 
ically L^(2n) times a scaled F^-norm of /. (This will actually follow from Theorem ll.il but 
can also be shown by a direct computation resembling the one in Section 0) This motivates 
to replace Xf >n with / G B by 



-seal ._ X f,n ~ nfo _ Y , ix s ._ /(g ) ~ fo 
\f,n ■ / 77TT ^9n,n, iJn^ ) ■ , -— ■ 
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Then using 



E m Je iXx r,n} =detM u Ja x , 



with a\ ;Yl = e tX9n . Because i^{2n) — > oo, the elements g n (n G N) lie in a compact subset of 
B, and so a^n he in a compact subset of $(-B) (see also Proposition I4.3( iii)). 
By Theorem 14.4( b) 

,. detM Min (a Ain ) 

urn — — | — - = hm H [a\ n \ , 

«^oo G[a x , n ] n ■ exp(tTaceP n T(a Xn )K IJ ,(ax,n)Pn) n ^°° 

due to uniform convergence on compact subsets. The regularized determinant H[a\ )n ] con- 
verges to H[l] = 1 since T(a^ 1 n )K^(a\ : n) — > T(1)K^(1) = in the Hilbert-Schmidt norm. 
Here we have to use Proposition 13.31 and the estimate implied by (HS). 

Again by Proposition I4.3( iii). G[ctA,n] = 1- To evaluate the trace we will used Theorem 
CTi). Define 

h = i\{f - f ) and s n = J~i^2n) 
and introduce the functions p n , q n G B via series expansion 

a x>n = e h/Sn = 1 + h/s n + p n /s 2 n , a^ n = e~ h/s " = 1 - h/s n + q n /s 2 n . 

Notice immediately that p n — > h 2 /2 and q n — » /i 2 /2 in the norm of B. Denoting t n (b,a) = 
trace (P n T (bjK^a) P n ) we have that 

/ _i x _ t n (/i, fc) -t n (h,p n ) +t n (q n ,h) + s~H n (p n , q n ) 

t n{Q-X : n, a \,n) — 2 + 3 

because in general t n (6, 1) = t n (l,a) = 0. Theorem I5.4( i) says that for a,b G B we have 
t n (b,a) = f2(a, 6)s^ + o(s^) and that the convergence is uniform on compact sets. Hence, 
applying this to all of the above expressions involving t n and using that p n and q n are from 
compact subsets of B, it follows that 

f27T 

? dx. 



A A f 

hm ^(0^,0^) = -n(M) = - T E *V*/-k = -7" / (^'( e "))' 

fc=— 00 

This implies 

Km E m , n [e iAx r'] = exp (~y £ *V*/-*1 = exp (-^ j\f{^)f dx^j (62) 

completing the proof of Theorem 11.11 Moreover, it is easy to see that the convergence (l62l) 
is uniform on bounded sets of A and compact sets of / G B. 
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Appendix: On the Toeplitz o Hankel formula 

We wish to compute the integral 



z k — H\ 



k=l k<£ k=l 

J0\ 



where dm is radial (dm(z) = dOdpi(r), z = re ) and Z mn is chosen so that X mn (l) = 1. 
To begin, write 



n 



z k — Z£\ 



det 



where [zj. x ] denotes the n x n matrix with z e k 1 in row k and column £. That is to say, 



n 



Zk - Zj> 



det 



En - \-^n -2 

k=l Z k 2^,k=l Z k 

En \-~\n — \-~\n — j 

k=l Z k Z^k=l Z k Z k l^k=l Z k Z h 



Now expand the first column on the right hand side via the linearity of the determinant, 
writing it as sum of n determinants with first column [1, z^, z%, . . . , z^~ 1 ]. By the product 
structure of Y[f( a - r gZk)dm(z k ) each of the resulting n integrals are the same. Thus, we can 
replace the Yl \zk — ze\ 2 in the measure with 



det 



1 ELi z k 

k=\ Z kZk 2^k=l Z k Z k 



Z^k=i Zk 



det 



1 Efc=2 Z k 

En - \r^n -2 

k=2 Z k Z k Z^k=2 Z k Z k 



Z^fc=2 Z-k 



at the cost of introducing a constant factor which may be absorbed into Z m ^ n . This procedure 
may be repeated, and after the n-th iteration we conclude that 



1 



J^y?(arg z k ) det 



Z k Z k 



k=l 



J Kkl<n 



[ J dm(z k ) 



k=l 



Z m , n ^ JC 



det — / ip(argz)z z dm(z 



0<kl<n-l 



after using the linearity of the determinant once more. And, as 

-!- / ip(argz)z e z k dm(z) = [ r k+l dfi(r) = (p k _ e m k+e , 

ZK Jc JO 

setting (f = 1 we find that Z m>n = n)c=o m 2fc; an d so formula fl2]). 
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